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"METHOD AND DEVICE FOR CODING A DIGITAL COLOR VIDEO SEQUENCE 11 



FIELD OF THE INVENTION 

The present invention generally relates to video compression and, more 
particularly, to a method of coding an input digital video sequence corresponding to an 
original color image sequence, said method comprising at least the following steps : 

(1) a converting step, provided for converting said video sequence from 
the original spatial representation domain into less representation data (for example, 
such as used in transform coding, mesh-based coding, predictive coding, etc..) ; 

(2) a quantization step, provided for transforming the converted signals 
thus obtained into a reduced set of data ; 

(3) an encoding step, provided for coding said reduced set of data. 
The invention also relates to"aWrespondihg encoder, to a method of 

decoding signals coded by means of said coding method, to a corresponding decoder, 
and to systems comprising computer readable program codes for implementing said 
coding and decoding methods. 



BACKGROUND OF THE INVENTION 

Data compression systems generally operate on an original data stream by 
exploiting the redundancies in the data, in order to reduce the size of said data to a 
compressed format more adapted to a transmission or storing operation. For these 
data, several color spaces may be used (a color space is completely parametrized with 
three colors linearly independent), and for instance the red-green-blue (RGB) color 
space (which is still severely redundant) or the so-called opponent color space, 
nominally white/black (or WB), red/green (or RG) and blue/yellow (or BY), or, in the 
video case, the YUV space. 

In classical video approaches, the video is often encoded along the three 
following separate channels : luminance Y, component U of chrominance, component V 
of chrominance. As it seems difficult, with this classical (Y, U, V) representation scheme, 
to highly improve the rate/distorsion ratio, it has been proposed in the european patent 
application n° 02290484.1 filed on February 28, 2002, by the applicant (PHFR020014) 
to change the representation space in order to achieve a higher coding efficiency (for 
example in order to encode more information with the same bit budget, or less 
information with far less bits). The coding method described in said document mainly 
comprises, before the coding step, a pre-processing step, provided for verifying in which 
color space the input video sequence is and transforming said space into a less 
redundant one by means of a non linear transformation. However, less information may 
lead to a lower quality. 
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SUMMARY OF THE INVENTION 

It is therefore a first object of the invention to propose another encoding 
method for the compression of a digital color video sequence, allowing to transform the 
original color space of said sequence into a less redundant one, by means of a non- 
5 linear transformation taking into account the possible lower quality finally obtained. 

To this end, the invention relates to a coding method such as defined in 
the introductory part of the description and which is moreover characterized in that it 
also comprises, before said converting step, a pre-processing step, provided for 
determining if the input video sequence is in YUV color space, where Y is the luminance 

10 component and U, V the chrominance components, and transforming said space into a 

less redundant color space by means of a non-linear transformation taking into account 

the possible lower quality finally obtained. 

By coding with a greater precision all the relevant part of the information, 
whereas non-relevant information may be degraded, a better coding efficiency is 
15 obtained. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will now be described in a more detailed manner, with reference to 
the accompanying drawings in which : 

Fig.l illustrates an uniform luminance dynamic compression ; 
20 - Fig.2 illustrates an example of perceptual dynamic compression according to 

the invention ; 

- Fig.3 illustrates the case of different ratios for the luminance compression, 
according to the concerned range ; 

- Fig.4 illustrates an adaptive and piecewise continuous compression for the side 
25 ranges, according to the invention ; 

Fig.5 illustrates how the original luminance values can be clustered outside the 

central range ; 

Figs.6 and 7 depict respectively a coding device and decoding device according 

to the invention. 



30 DETAILED DESCRIPTION OF THE INVENTION 

It is obvious that, for a wide range of applications (such a digital movies, 
high-definition television, transmission or visualization of scientific imagery,...)/ the 
ultimate consumer is the human eye. The basic idea of the invention is then to choose a 
representation based upon the partition of the visual signals by the early human visual 
35 system, i.e. to design the image codes in such a way that they match the visual 

capacities of the human observer. 
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Perceptual studies have already shown that, under standard viewing 
conditions, human eyes cannot distinguish small luminance variations (from 1 to 5 grey 
levels). A common approach has then consisted in uniformly compressing the luminance 
dynamic by using less grey levels, for example using 128 luminance grey levels instead 
of 256 ones (as illustrated in Rg.l), which is equivalent to a 7 bits luminance coding. 
Tests have shown that if this luminance dynamic compression followed by the inverse 
transform are applied to an image, human eyes cannot detect any variation between 
the original image and the reconstructed one. 

The novel idea consists in adaptively compressing the luminance dynamic. 
Perceptual tests performed by the applicant show that, for a luminance dynamic 
including 256 grey levels (from 0 to 255 for example), human eyes are more sensitive 
to luminance changes inside the luminance range [70 ; 130] than in the range [0 ; 70] 
or in the range [130 ; 255]. More generally, the applicant has considered that, for a 
luminance dynamic including N grey levels (from 0 to N-l for example), a more relevant 
information is the one located in a central range [A ; B] and a less relevant information 
is located in the side ranges [0 ; A] and [B ; N-l]. 

In order to exploit this property of a variable perception according to the 
considered luminance ranges, it is then proposed, given an original luminance range of 
N grey levels (for example from 0 to N-l as illustrated in Fig.2) and, according to the 
uniform luminance dynamic compression illustrated in Rg.l, a corresponding output 
luminance range of M grey levels (for example from 0 to M-l as shown in Fig.2) with M 
lower than N, to keep unchanged the luminance dynamic inside the central range 
[A ; B] and to compress the luminance outside said central range. As shown in Fig.2, it 
means that B-A = D-C, although M lower than N (C and D being the values that 
correspond, between 0 and M-l, to the values A and B of the range [0 ; N-l]), while 
[0 ; q is lower than [0 ; A] and [D ; M-l] is lower than [B ; N-l]. As seen above, tests 
performed by the applicant show that A - 70 and B = 130 are the values preferably 
chosen (for N = 256). For instance, in the example illustrated in Fig.3, the luminance 
dynamic is kept unchanged between 70 and 130, whereas a compression ratio of 2 is 
used outside this range, between 0 and 70 and between 130 and 255. 

Practically, several compression modes may be proposed. In the example 
of Fig.2, the compression in the side ranges is uniform, but other solutions are possible. 
As illustrated in Rg.4, the compression may also be adaptive and piecewise continuous 
outside the central range. In this manner, the luminance compression is progressively 
lessened from 0 to A and from N-l to B. For instance, simple affine functions (three in 
Fig.4) may be used, but also more complex functions (such as sigmoid functions). 

An alternative solution may be to use different ratios for the values in the 
central range and the values outside it. For example, a ratio of 2 may be used in the 
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central range [70,130] and a higher ratio in the side ranges [0,70] and [130,255], for a 
compression from 256 grey levels to 64 ones (i.e with 6 bits). 

It may also be noticed that, because only M integer values are used after 
the dynamic compression, once the luminance transformation is performed, more 
5 precise values are used for original values inside the central range (between A and B), 

whereas outside said central range many original values are clustered (as depicted in 
Fig.5) in a single one (and clustered values can In turn be clustered in order to further 
increase the dynamic compression in anyone of the side ranges, or both). 

An embodiment of a coding device for the implementation of the coding 

10 method according to the invention is now described. As shown in Fig .6, the video 

sequence (video signal VS) is first presented to a preprocessor 61, the output of which 
ts received by an encoder 62. The data contained in the input video signal include pixel 
values which describe the color components (luminance signal Y, color difference signals 
U and V) of a corresponding location in the original images to which the video sequence 

15 corresponds. The encoder 62 comprises for instance a DCT (discrete cosine transform) 

transform circuit 161, which linearly transforms blocks of 8 x 8 pixels into the frequency 
domain, a quantizer 162, that receives the DCT coefficients thus obtained and performs 
their quantization, a variable length coder 163, that carries out the coding step of the 
quantized coefficients, and a rate controller 164, that stores the output signal of the 

20 coder 163 and sends to the quantizer 162 a feedback signal allowing to modify the 

quantization setting (such a rate controller generally comprises a buffer for receiving the 
coded bitstream and an update circuit for generating an updated quantization setting). 
The preprocessor 61 is provided for changing the representation space (Y, U, V) into 
the new space. 

25 At the decoding side, a decoding device is provided for implementing the 

above-mentioned inverse transformation and comprises, as shown in Fig.7, a decoder 
71 followed by a postprocessor 72 carrying out the inverse transformation allowing to 
recover the true color image CI. Said decoder, that receives the bitstream coded by 
means of the coding device described above, usually comprises a variable length 

30 decoder 171, an inverse quantization circuit 172, an inverse DCT circuit 173, and 

reconstruction circuit 174. 

The encoding and decoding devices, (61, 62) and (71, 72) respectively, can be 
implemented in a variety of ways to perform the functionalities described herein. In one 
embodiment, they may be embodied as software stored on media and executed by a 

35 general purpose or specifically configured computer system, typically including a central 

processing unit, memory and one or more inputyoutput devices and processors. 
Alternatively, they may be implemented as a combination of hardware, software or 
firmware, without excluding that a single item of hardware or software can carry out 
several functions or that an assembly of items of hardware or software or both carry out a 
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single function. The described methods and devices may be implemented by any type of 
computer system or other apparatus adapted for carrying out the methods described 
herein, this computer system including a computer program that, when loaded and 
executed, controls the computer system such that it carries out the methods described 
herein. 



carrying out one or more of the functional tasks of the invention, can be utilized. The 
present invention can also be embedded in a computer program product, which comprises 
all the features enabling the implementation of the methods and functions described 
herein, and which - when loaded in a computer system - is able to carry out these 
methods and functions. Computer program, software program, program, program product, 
or software, in the present context mean any expression, in any language, code or 
notation, of a set of instructions intended to cause a system having an information 
processing capability to perform a particular function either directly or after either or both 
of the following : (a) conversion to another language, code or notation ; and/or (b) 
reproduction in a different material form. 



Alternatively, a specific use computer, containing specialized hardware for 
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CLAIMS : 

1. A method of coding an input digital video sequence corresponding to an 
original color image sequence, said method comprising at least the following steps : 

(1) a converting step, provided for converting said video sequence from 
the original spatial representation domain into less representation data ; 

(2) a quantization step, provided for transforming the converted signals 
thus obtained into a reduced set of data ; 

(3) an encoding step, provided for coding said reduced set of data ; 
said coding method being further characterized in that it also comprises : 

(4) before said converting step, a pre-processing step, provided for 
determining if the input video sequence is in YUV color space, where Y is the luminance 
component and U, V the chrominance components, and transforming said space into a 
less redundant color space by means of a non-linear transformation taking into account 
the possible lower quality finally obtained. 

2. A coding method according to claim 1, in which said pre-processing step is 
an operation consisting in compressing the luminance dynamic by using a number M of 
grey levels lower than the original number N before said compression operation, said 
compression operation being characterized in that said luminance dynamic of N grey 
levels is divided into a central range [A ; B] and two side ranges [0 ; A] and [B ; N-l], 
and the original side ranges [0 ; A], [B ; N-l] are transformed by means of the 
compression operation into transformed side ranges [0 ; C], [D ; M-l], with [0 ; C\ 
lower than [0 ; A] and [D ; M-l] lower than [B ; N-l], the original central range [A ; B] 
being kept unchanged in such a way that [C ; D] = [A ; B]. 

3. A coding method according to claim 2, characterized in that the 
compression in said side ranges is uniform. 

4. A coding method according to claim 1, in which said pre-processing step is 
an operation consisting in compressing the luminance dynamic by using a number M of 
grey levels lower than the original number N before said compression operation, said 
compression operation being characterized in that said luminance dynamic of N grey 
levels is divided into a central range [A ; B] and two side ranges [0 ; A] and [B ; N-l], 
and the original central range [A ; B] and side ranges [0 ; A] [B ; N-l] are transformed 
by means of the compression operation respectively into a transformed central range 
[C ; D] and into transformed side ranges [0 ; CJ, [D, M-l], with [0 ; C] lower than 

[0 ; A], [C ; D] lower than [A ; B] and [D ; M-l] lower than [B ; N-l], the compression 
ratio applied to the original central range [A ; B] being lower than the one applied to 
the original side ranges. 

5. A coding method according to claim 4, characterized in that the 
compression ratio in said central and side ranges is uniform. 
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6. A coding method according to anyone of claims 2 and 4, characterized in 

that the compression in said side ranges is adaptive and piecewise continuous, the 
luminance compression being progressively lessened in the part of each of said side 
ranges which is contiguous to the central range. 
5 7. A coding method according to claim 6, characterized in that one or several 

affine functions are used for the progressive lessening of the luminance compression in 
said contiguous parts. 

8. A coding method according to claim 6, characterized in that sigmoid 

functions are used for the progressive lessening of the luminance compression in said 

.10 contiguous parts. 

9. A coding method according to anyone of claims 5 to 7, characterized in 

that, after the luminance dynamic compression, some transformed values are still 
clustered in the side ranges, in view of a further dynamic compression in said ranges, 

10. A device for coding an input digital video sequence corresponding to an 
15 original color image sequence, said device comprising at least : 

(1) converting means for converting said video sequence from the original 
spatial representation domain into less representation data ; 

(2) quantization means for transforming the converted signals thus 
obtained into a reduced set of data ; 

20 (3) encoding means for coding said reduced set of data ; 

said coding device being further characterized in that it also comprises : 

(4) before said converting means, pre-processing means for determining if 

the input video sequence is in YUV color space, where Y is the luminance component 

and U, V the chrominance components, and transforming said space into a less 
25 redundant color space by means of a non-linear transformation taking into account the 

possible lower quality finally obtained. 

11. A coding device according to claim 10, in which said pre-processing means 
are a compression stage in which the luminance dynamic is reduced by using a number 
M of grey levels lower than the original number N before compression, luminance 

30 dynamic of N grey levels is divided into a central range [A ; B] and two side ranges [0 ; 

A] and [B ; N-l], and the original side ranges [0 ; A], [B ; N-l] are transformed by 
means of the compression operation into transformed side ranges [0 ; C], [D ; M-l], 
with [0 ; C] lower than [0 ; A] and [D ; M-l] lower than [B ; N-l], the original central 
range [A ; B] being kept unchanged in such a way that [C ; D] = [A ; B]. 

35 12. A coding device according to claim 10, in which said pre-processing means 

are a compression stage in which the luminance dynamic is reduced by using a number 
M of grey levels lower than the original number N before compression, the compression 
operation being characterized in that said luminance dynamic of N grey levels is divided 
into a central range [A ; B] and two side ranges [0 ; A] and [B ; N-l], and the original 
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central range [A ; B] and side ranges [0 ; A] [B ; N-l] are transformed by means of the 
compression operation respectively into a transformed central range 
[C ; D] and into transformed side ranges [0 ; C], [D, M-l], with [0 ; C] lower than 
[0 ; A], [C ; D] lower than [A ; B] and [D ; M-l] lower than [B ; N-l], the compression 
ratio applied to the original central range [A ; B] being lower than the one applied to 
the original side ranges. 

13. A system comprising a computer usable medium having computer readable 
program code means embodied therein for implementing a digital video coding device 
provided for coding an input digital video sequence corresponding to an original color 
image sequence, said computer readable program code means comprising the following 
computer readable program codes : 

- a program code for causing said computer to detect if the input color 
video sequence is in YUV color space, where Y is the luminance component and U, V the 
chrominance components, and to transform said space into a less redundant color space ; 

- a program code for causing said computer to convert said transformed 
sequence from the original spatial representation domain into a new representation 
domain with less representation data ; 

- a program code for causing said computer to perform a 
quantization of said converted sequence ; 

• a program code for causing said computer to encode the 
quantized data thus obtained. 

14. A method of decoding signals coded by means of a coding method according 
to claim 1. 

15. A device for decoding signals coded by means of a coding device according to 
claim 14. 

16. A system comprising a computer usable medium having computer readable 
program code means embodied therein for implementing a digital video decoding device 
according to claim 15. 
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Abstract 

The invention relates to a method of coding an input digital video sequence 
corresponding to an original color Image sequence, said method comprising at least a step 
for converting said video sequence from the spatial domain into less representation data, a 
quantization step, for transforming the converted signals thus obtained into a reduced set 
of data, and a step for coding said reduced set of data. According to the invention, said 
coding method also comprises, before said converting step, a pre-processing step, provided 
for determining if the input video sequence is in YUV color space -Y being the luminance 
component and U, V the chrominance components- and transforming said space into a less 
redundant color space by means of a non-linear transformation taking into account the 
possible lower quality finally obtained. 
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Luminance transformation implies different transformed values depending on the luminance 
value: outside the visible strip many values are clustered on a single one. 
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